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(57) Abstract: The invention relates to a 
system for processing a series of image 
frames representing a cardiac cycle, at least 
comprising input or data collection means 
for collecting the series of image frames, a 
memory inter alia for storing and retrieving 
said series of image frames, a processor for 
processing the frames, and display means, 
whereby in use the processor processes 
the frames to identify from said series of 
images a frame or frames representing a 
pre-determined phase of the cardiac cycle 
whereby the processor compares images 
from said series of image frames and 
establishes a measure of identity between 
such frames, whereby the processor applies 
said measure of identify to identify the 
phase of the cardiac cycle pertaining to such 
frames. 
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System and method for processing a series of image firames representing a cardiac cycle 



The invention relates to a system for processing a series of image firames 
representing a cardiac cycle, at least comprising input or data collection means for collecting 
the series of image fi-ames, a memory inter aUa for storing and retrieving said series of image 
firames, a processor for processing the firames, and display means, whereby in use the 
5 processor processes the firames to identify firom said series of images a fi-ame or firames 
representing a pre-determined phase of the cardiac cycle. 

The invention fiirther relates to a method for processing a series of image 
firames representing a cardiac cycle in order to identify firom said series of images a frame or 
firames representing a pre-determined phase of the cardiac cycle. 
1 0 Such a system and method are known firom W^O 01/82787. Generally it is 

required to identify the systolic phase and the diastolic phase of a heart under examination in 
order to be able to determine further heart parameters such as the stroke volume, the ejection 
firactiori and other parameters. Normally, the systolic phase and the diastolic phase of the 
heart can be easily determined by means of an ECG-signal. When, however, such an ECG- 
15 signal is not available or when it is not possible to avail of this ECG-signal the problem 

occurs that in order to be able to assess a variety of heart parameters it is a prerequisite that 
an accurate determination of the systolic phase and the diastolic phase of the heart are 
determined. 

Although the invention is applicable to the selection of the image firames that 
20 show the heart in its systoUc phase and in its diastoUc phase, the invention is not restricted to 
only this pxnpose but can be used to identify also other phases in the heart's cardiac cycle. 

WO 01/82787 relates to an automatic method for evaluating image data taken 
over a sequence of image firames in order to determine a contour of a left ventricle of a heart 
under examination. According to this known art end diastole and end systole aortic valve 
25 points are entered whereby an initial end diastole region/end systole region classifier is 

developed using a probability look-up table. Also provided are training data determined firom 
manually drawn contours of hearts of other individuals than the person under examination. 
Regression coefficients derived firom the training data are then appUed to deteimme the end 
diastole boundary and the end systole boundary which can be used to calculate an ejection 
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fraction for the heart. This known method is complicated and reqiiires much manual input in 
order to be able to obtain the diastole and systole boundaries of the heart 

It is an object of the invention to provide a system which effectively idmtifies 
the frames that are representative for a predetermined phase of the cardiac cycle of the heart 
5 under examination. A further object is that the manner of operation of this system may be 
automatic, will allow the ease of processing the series of image frames, and is simple to 
unplement. 

The invention is embodied in a method and system and furthermore in 
software and a data carrier comprising this software as specified in the appended claims. 

10 In a first aspect of the invention the system for processing a series of image 

frames r^resenting a cardiac cycle is characterized in that the processor compares images 
from said series of image frames and establishes a measure of identity between such firames, 
whereby the processor applies said measure of identity to identify the phase of the cardiac 
cycle pertaining to such fiiames. 

15 Practice has shown that the system according to the invention provides robust 

means to identify the phase of the cardiac cycle which is of interest for the examination. 

A first preferred embodiment of the system according to the invention is 
characterized in that the processor compares consecutive frames from the series of images, 
and selects from the series of images the frames showing the highest value of the measure of 

20 identity as pertaining to the systolic resting-phase and the diastolic resting-phase of the 
cardiac cycle. Preferably the processor compares pairs of consecutive frames. 

Apart from the property that the system according to the invention may carry 
out the identification of the concerning phase of the cardiac cycle completely automatic a 
further property lies in that the determination of the different cardiac phases is easy. The 

25 phases are simply related to such frames that show the highest value of identity in case the 
most quiescent heart phases are intended to discover, i.e. the systolic resting-phase and the 
diastolic resting-phase. If on the oth^ hand one wishes to detect the heart phase with the 
most prominent motion one has to select in this embodiment the fiiames showing the lowest 
value of the measure of identity. 

30 In another preferred embodiment of the system according to the invention the 

processor compares each frame from said series with every other bdmc Scorn the series of 
images, and selects a first frame and a second firame from said series of images showing the 
lowest value of said measure of identity, whereby the first firame and the second fimne are 
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ideatified to pertain to the systolic resting-phase and the diastolic resting-phase of the cardiac 
cycle. 

All embodunents of the system according to tiie invention allow to determine 
the phase of the heart under examination, for instance, the systoUc phase and the diastolic 
phase from a series of image frames representing a complete cardiac cycle without the need 
to rely on further measurements such as the ECG-signal. 

A further aspect is that the system can be applied on any type of image frames 
such as the image frames derived from a CT-scan, a MRI-scan or an ultrasound scan, 
although the system is particularly useful when appUed on a series of images that are derived 
from a MRI-scan. When collecting a series of unage frames with a MRI-scan the problem is 
that the ECG-signal that is otherwise available can not be used because the ECG corrupts the 
MRI-fi^es on the one hand, whereas on the other hand the ECG-signal is disturbed by the 
magnetic fields of the MRI-scan. 

In practice it appears that any suitable way of comparing the frames is 
feasible. The system according to the invention preferably however compares the frames by 
executing a cross-correlation function with regard to such fi^es whereby it assigns the 
value resulting from said cross-correlation as representing the said measure of identity. 

hi a further preferred embodiment the processor compares the image fi^es 
with reference to and restricted to a pre-selected area of the images on the frames. In this way 
the identification of the sought for heart phase can be supported by a proper selection of the" 
area which is used for comparison. 

Suitably the comparison is made by selecting the area which represents the 
right coronary artery and its immediate surroundings. 

Hereinafter the invention will be further elucidated with reference to the 
following non-limiting exemplary embodunents of the system and method according to the 
invention, and with reference to the annexed figures. 



Fig. 1 shows the system according to the invention. 

Fig. 2 shows results obtained with a first embodiment of the system according 
to the invention. 

Figs. 3 and 4 show two image fi^es selected from a series of image frames 
representing a complete cardiac cycle. 



wo 2004/054443 PCT/IB2003/005511 

4 

Fig. 5 shows the result obtamed with a second embodiment of tfie system 
according to the invention. 



Referring now first to Fig. 1 the system for pro- cessing a series of image 
frames representing a cardiac cycle is indicated in general with reference numeral 1. This 
system 1 at least comprises input or data collection means 2 for collecting of image frames 
from the heart under examination. These unage frames may be inputted into the system 1 off- 
line or on-line meaning that flie ii^ut or data collection means may be a CT-scan-, a MRI- 
scan- or an ultrasound-scan apparatus, or flie s^aratus may be a memory device or a 
compute carrying the data from the concerning scan. 

The said input or data collection means 2 are connected to a memory 3 which 
is inter alia intended for storing and retrieving the series of unage frames. The memory 3 is in 
turn connected to a processor 4 for processing the frames and display means 5 which is 
intended to show results of the processing and/or the Aames that are being processed. 

When the system 1 is in use the processor 4 processes the frames to identify 
from the series of image frames such frame or frames that rq^resent a predetermmed phase of 
the cardiac cycle. For this purpose the processor 4 compares images from the series of image 
frames and estabUshes a measure of identity between such frames whereby the processor 4 
appUes said measure of identity to identify the phase of the cardiac cycle to pertaining to such 
frames. 

In a first embodiment of the system 1 according to the invention the processor 
4 compares consecutive frames from the series of images and selects the frames showing 
within these smes of images the highest value of the measure of identity as pertaining to the 
systolic resting-phase and the diastolic resting-phase of the cardiac cycle. Preferably this is 
done such that the processor 4 compares pairs of consecutive fiimnes. 

In an exemplary application of this first embodiment the system made use of a 
clinical 1.5 T-scanner of the make Gyroscan ACS-NT15 marketed by Philips Medical 
Systems. After completion of a multi-heart phase cine scan, the global cross-correlation 
within each pair of consecutive cine images was determined by the system. Through this 
global cross-correlation fimction pertaining to the frames a direct measure of the differences, 
or in other words the measure of identity between successive images was determined and it 
was shown that this measure of identity represents a robust measure for the relative changes 
between the consecutive images. 
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Experiments were carried out on seven healthy volunteers and two- 
dimensional ECG-gated breath-hold series of image frames were obtained wherein the field 
of view measured 320 mm x 224 mm. Thirty (30) heart phases were measured. A transversal 
orientation was chosen containing the intersection with the tight coronary artery which 
proved to be preferable in view of the motion amplitude of this part being larger than that of 
the left system of the heart. A comparison was made with the visually determined rest periods 
of the right coronary artery and compared to the frame positions where a maximum of the 
correlation curves occurred. 

Fig. 2 shows the correlation gr^h for three selected volunteers in which the 
X-axis shows the development of a complete cardiac cycle and the Y-axis shows the 
correlation value depending on the frame position within the cardiac cycle. The visually 
derived rest periods corresponding to the end diastolic and end systolic phase of the heart 
coincide with the frames that show the highest value of the measure of identity as determined 
by the cross-correlation ftinction that the system according to ttie invention preferably 
applies. 

In a second embodiment the processor 4 of the system 1 according to the 
invention compares each frame from said series of image frames with every other fi^me from 
the series and selects a JBrst frame and a second frame from said series of images showing the 
lowest value of said measure of identity whereby the first frame and the second frame are 
identified to pertain to the systolic resting-phase and the diastolic resting-phase of the cardiac 
cycle. 

The results of the system working according to this embodiment are shown in 
Figs. 3, 4 and 5. Figs. 3 and 4 show a human heart at different moments of the cardiac cycle. 
A typical cardiac cycle consists of at least thirty of such frames as shown in Figs. 3 and 4 
respectively. 

According to the invention each firame Scorn the series offices (such as the 
frames shown in Figs. 3 and 4) is compared with every other frame from the series of frames 
and the result of the comparison is converted into a measure of identity. 

Fig. 5 shows the collected measures of identity for all the possible 
combinations of pairs of frames from the series of frames representing a complete cardiac 
cycle. In this particular case Fig. 5 shows on both the horizontal and the vertical axis all 
fi^es from one series of frames, numbered 1-30, resulting in a total of 'AN.iN-^l) possible 
combinations in which N^30 is the total number offices. 
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Fig. 5 shows the result of the comparison whereby the white areas r^resait 
full identity between the two compared frames and the darker areas r^iresent less 
correspondence between the con^iared frames. The darkest areas represent the least 
correspondence between the compared frames. 

Based on the above the areas marked with the arrows A and B relate to the 
combinations of frames showing the largest differences between the compared frames. Based 
on this result the systolic frame showing the contraction of the heart and the diastoUc frame 
showing the heart in relaxed condition can be identified as fimies 10 and 30 respectively. 

Finally, it is remarked that the invention is not restricted to use wifli MRI- 
scans only. It can easily well be appUed with CT-scans, ultrasound scans and any other scan 
that may be developed in future. 

The invention can furtha- easily well be applied with image fimies from flie 
heart taken from a perspective that differs from the frames shown in Figs. 3 and 4 
respectively. The invention is insensitive to the viewing direction at wliich flie heart under 
1 5 examination is being monitored. In short: the invention is not limited to flie specific 

embodiments discussed above. This discussion merely serves to elucidate the appended 
claims without intending to limit the scope of protection of these claims. 
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1 • System for processing a series of image frames representing a cardiac cycle, at 

least comprising input or data collection means for coUecting the series of image frames, a 
memory inter alia for storing and retrieving said series of image frames, a processor for 
processing the frames, and display means, whereby in use the processor processes the frames 
to identify from said series of images a frame or frames representing a pre-determined phase 
of the cardiac cycle, characterized in that the processor compares images from said series of 
image fi^es and establishes a measure of identity between such frames, whereby the 
processor applies said measure of identify to identify the phase of the caixiiac cycle pertaining 
to such frames. 

2- Sj^tem according to claim 1 , characterized in that the processor compares 
consecutive frames from the series of images, and selects from the series of images the 
frames showing the highest value of the measure of identity as pertaining to the systolic 
resting-phase and the diastolic resting-phase of the cardiac cycle. 

3- System according to claim 2, characterized m that the processor compares 
pairs of consecutive frames. 

4- System accordmg to claim 1, characterized in that the processor compares 
each frame from said series wiA every other frame from the series of images, and selects a 
first fi^e and a second frame from said series of images showing the lowest value of said 
measure of identity, whereby the first frame and ttie second firame are identified to pertain to 
the systolic resting-phase and the diastolic resting-phase of the cardiac cycle. 

5- System according to any one of claims 1-4, characterized in that the processor 
compares the frames by executing a cross-correlation fimction with regard to such frames, 
whereby it assigns the value resulting from said cross-correlation as representing the said 
measure of identity. 
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^- System according to any one of the previous claims, characterized in that the 

processor compares the image frames witti reference to and restricted to a pre-selccted area of 
the images on the frames. 



System according to claim 6, characterized in that the pre-selected area is the 
right coronary artery and its immediate surromidings. 

8, Software for use is conjmiction with a processor for processing a series of 

image frames in order to identify from said series of images a frame or frames representing a 
pre-detOTnined phase of the cardiac cycle, characterized in that it includes an algorithm to 
establish a measure of identify between frames of the series of image frames, and to 
determine from said measure of identity the phase of the cardiac cycle to which the frames 
relate. 



9" Data carrier embodied with software according to claim 8. 

Method for processing a series of image frames representing a cardiac cycle m 
order to identify from said series of images a frame or frames representing a pre-determined 
phase of the cardiac cycle, characterized in that images from said series of image frames are 
compared to establish a measure of identity between such frames and that the measure of 
identity is used to identify the phase of the cardiac cycle pertaining to such fi^es. 

1 1 . Method according to claim 1 0, characterized in that consecutive frames from 
the series of images are compared and that the frames within the series of images are selected 
that show the highest value of tiie measure of identify as pertaining to the systolic resting- 
phase and the diastolic resting-phase of the cardiac cycle. 

12. Method according to claim 10, characterized in that each frame from the series 
of image frames is compared with every other firame from the series, and a first frame and a 
second frame from said series of images showing the lowest value of said measure of identify 
are selected, whereby the first frame and the second frame are identified to pertain to the 
systolic resting-phase and the diastohc resting-phase of the cardiac cycle. 
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